Table of Contents:

Appendix A to the 2018 Colorado Growth Model Report:
Growth Model Fit Plots

October 2018

1 Student Growth Percentile Fit Plots

A goodness of fit plot is produced for each unique analysis run in 2018. All fit plots will contain at least four panels. Each panel is a different depiction of the distribution of the Student Growth Percentiles (SGPs) calculated in that analysis relative to the students’ prior or current achievement (i.e. the test scores used as the independent and dependent variables in the model).

The top panel is a mosaic plot that shows the percentage of students that fall into each prior proficiency level, and the location of the 10th through 90th quantiles of the SGP distribution represented as dashed white lines (with the exception of the solid white line for the median/50th percentile). Ideally the median SGP will be at or near 50 for all prior achievement level groups. The top panel is excluded when students’ prior achievement level data is unavailable.

The “Ceiling/Floor Effects Test” panel helps identify problems in SGP estimation at the Highest and Lowest Obtainable/Observed Scale Scores (HOSS and LOSS). Appendix C provides a more detailed description of ceiling and floor effects and their causes. The table of values shows whether the current year scores at both extremes yield expected SGP values. The expectation is that the majority of SGPs for students scoring at or near the LOSS will be low (preferably less than 5 and not higher than 20), and that SGPs for students scoring at or near the HOSS will be high (preferably higher than 95 and not less than 80). Because few students may score exactly at the HOSS/LOSS, the top/bottom 50 students are selected and any student scoring within their range of scores are selected for inclusion in these tables. Consequently, there may be a range of scores at the HOSS/LOSS rather than a single score, and there may be more than 50 students included in the HOSS/LOSS row if the 50 students at the extremes only contain the single HOSS/LOSS score.

The “Student Growth Percentile Range” panel at bottom left shows the empirical distribution of SGPs given prior scale score deciles in the form of a 10 by 10 cell grid. Percentages of student growth percentiles between the 10th, 20th, 30th, 40th, 50th, 60th, 70th, 80th, and 90th percentiles were calculated based upon the empirical decile of the cohort’s prior year scaled score distribution1. Deviations from perfect fit are indicated by red and blue shading. The further above 10 the darker the red, and the further below 10 the darker the blue. A more detailed discussion about the reasons for and implications of model misfit can be found in the “Goodness of Fit” section of the 2018 Colorado Student Growth Model report.

The bottom right panel of each plot is a Q-Q plot which compares the observed distribution of SGPs with the theoretical (uniform) distribution. An ideal plot here will show black step function lines that do not deviate from the ideal, red line which traces the 45 degree angle of perfect fit.

2 End-of-Grade Analyses

2.1 ELA

Fig. A.1: Goodness of Fit Plot for 2018 Grade 4 ELA One Prior.

Fig. A.2: Goodness of Fit Plot for 2018 Grade 5 ELA Two Priors.

Fig. A.3: Goodness of Fit Plot for 2018 Grade 6 ELA Two Priors.

Fig. A.4: Goodness of Fit Plot for 2018 Grade 7 ELA Two Priors.

Fig. A.5: Goodness of Fit Plot for 2018 Grade 8 ELA Two Priors.

2.2 Mathematics

Fig. A.6: Goodness of Fit Plot for 2018 Grade 4 Mathematics One Prior.

Fig. A.7: Goodness of Fit Plot for 2018 Grade 5 Mathematics Two Priors.

Fig. A.8: Goodness of Fit Plot for 2018 Grade 6 Mathematics Two Priors.

Fig. A.9: Goodness of Fit Plot for 2018 Grade 7 Mathematics Two Priors.

Fig. A.10: Goodness of Fit Plot for 2018 Grade 8 Mathematics Two Priors.

3 PSAT/SAT Analyses (by Course Progression)

3.1 ELA PSAT 9

Fig. A.11: Goodness of Fit Plot for 2018 ELA PSAT 9 (Priors 2017 ELA Grade 8, 2016 ELA 7).

3.2 ELA PSAT 10

Fig. A.12: Goodness of Fit Plot for 2018 ELA PSAT 10 (Priors 2017 ELA Grade 9, 2016 ELA Grade 8).

3.3 ELA SAT

Fig. A.13: Goodness of Fit Plot for 2018 ELA SAT (Priors 2017 ELA PSAT 10, 2016 ELA Grade 9).

3.4 Mathematics PSAT 9

Fig. A.14: Goodness of Fit Plot for 2018 Mathematics PSAT 9 (Priors 2017 Algebra I, 2016 Math Grade 7).

Fig. A.15: Goodness of Fit Plot for 2018 Mathematics PSAT 9 (Priors 2017 Geometry).

Fig. A.16: Goodness of Fit Plot for 2018 Mathematics PSAT 9 (Priors 2017 Math Grade 8, 2016 Math Grade 7).

3.5 Mathematics PSAT 10

Fig. A.17: Goodness of Fit Plot for 2018 Mathematics PSAT 10 (Priors 2017 Algebra I, 2016 Math Grade 8).

Fig. A.18: Goodness of Fit Plot for 2018 Mathematics PSAT 10 (Priors 2017 Geometry, 2016 Algebra I).

Fig. A.19: Goodness of Fit Plot for 2018 Mathematics PSAT 10 (Priors 2017 Integrated Math 1, 2016 Math Grade 8).

3.6 Mathematics SAT

Fig. A.20: Goodness of Fit Plot for 2018 Mathematics SAT (Priors 2017 Math PSAT 10).

Fig. A.21: Goodness of Fit Plot for 2018 Mathematics SAT (Priors 2017 Math PSAT 10, 2016 Algebra I).

Fig. A.22: Goodness of Fit Plot for 2018 Mathematics SAT (Priors 2017 Math PSAT 10, 2016 Algebra II).

Fig. A.23: Goodness of Fit Plot for 2018 Mathematics SAT (Priors 2017 Math PSAT 10, 2016 Geometry).

Fig. A.24: Goodness of Fit Plot for 2018 Mathematics SAT (Priors 2017 Math PSAT 10, 2016 Integrated Math 1).


  1. The total students in each analysis varies depending on grade and subject, and prior score deciles are based only on scores for students used in the SGP calculations.